Approximating Partition Functions of Two-State Spin 

Systems 

q ! Jinshan Zhang*Heng Liang and Fengshan Bai 

f^*) | Department of Mathematical Sciences, Tsinghua University, 



Beijing 100084, China 



(N 

> 
O 

ON ! Abstract 

(N 

Two-state spin systems is a classical topic in statistical physics. We consider the problem 
of computing the partition function of the systems on a bounded degree graph. Based on 
the self-avoiding tree, we prove the systems exhibits strong correlation decay under the con- 
dition that the absolute value of "inverse temperature" is small. Due to strong correlation 
decay property, an FPTAS for the partition function is presented under the same condition. 
This condition is sharp for Ising model. 
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1. Introduction 

Spin model with p states is a classical mathematical model in statistical physics. 
Such models describe and explain the behavior of ferromagnets, lattice gas and cer- 
tain other phenomena of statistical physics. In this paper, we focus on the case 
of two spins. This case encompasses models of physical interest, such as the clas- 
sical Ising model (ferromagnetic or antiferromagnetic, with or without an applied 
magnetic field). 

In statistical mechanics, the partition function is an important quantity that 
encodes the statistical properties of a system in thermodynamic equilibrium. How- 
ever, partition functions are normally hard to compute, even for the two-state spin 
systems [5]. Markov Chain Monte Carlo methods [11] are the existing powerful 
approach. 
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Exploiting the structure property of Gibbs measure, Weitz [To] and Bandyopad- 
hyay, Gamarnik [JJ introduce new deterministic algorithm for counting the number 
of independent sets and colorings. The key point of this method is to establish the 
strong spatial mixing property, which is also known as strong correlation decay, 
on certain defined rooted trees. It follows that the marginal probability of the root 
is asymptotically independent of the configuration on the leaves far below. In |15j . 
Weitz proves the strong correlation decay for hard-core model on bounded degree 
trees and pushes the result to general graph using the self -avoiding tree technique. 
The proof employs the recursive formula for computing the marginal probability 
of a vertex on the tree. This approach is well known for some kinds of statistical 
systems, such as Ising model [12] and coloring model [7]. 

It is natural to ask whether the more general two-state spin systems exhibits 
strong correlation decay. We present a positive answer based on the recursive formula 
on bounded trees in this paper. We show that, for arbitrary external field, the 
Gibbs measure exhibits strong correlation decay on a bounded degree tree when the 
absolute value of the inverse temperature is smaller than J^, where Jd is critical point 
for uniqueness of Gibbs measures of (anti)ferromagnetic Ising model on an infinite 
d regular tree [U [T3]. This generalizes the recent result by Mossel and Sly [IT]. They 
prove the strong correlation decay for ferromagnetic Ising model. By the strong 
correlation decay, we prove that there exists an unique Gibbs measure of two-state 
spin systems on an infinite bounded degree graph. This generalizes the Dobrushion's 
condition, dtanh(J) < 1 to (d— 1) tanh(J) < 1, for the uniqueness of Gibbs measure 
of antiferromagnetic and ferromagnetic Ising models [31 HJ [14]. Since an infinite d 
regular tree is a special infinite bounded degree graph, the condition is sharp for 
Ising model. 

A fully polynomial time approximation schemes (FPTAS) for partition functions 
of two-state spin systems on a bounded degree graph is presented, which is natu- 
ral and reasonable when the strong correlation decay holds. Jerrum and Sinclair 
[6] provided an FPRAS to ferromagnetic Ising model for graphs with any uniform 
positive inverse temperature and identical external field for all the vertices. Their 
results do not include the case where different vertices have different external field, 
and are not applied to antiferromagnetic Ising model either. Very recently Dembo 
and Montanari propose an explicit formula for partition function of ferromagnetic 
Ising model with any external field on locally tree- like graphs, which still does not 
include the antiferromagnetic case [2]. 
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The remainder of the paper has the following structure. In Section 2, we present 
some preliminary definitions . We go on to prove the main theorem in Section 3. 
Section 4 is devoted to propose an FPTAS for the partition functions under our 
conditions. Further work and conclusion are given in Section 5. 

2. Notations and Definitions 

Let G = (V, E) be a finite graph with vertex set V = {1,2,- •• , n} and edge 
set E. Let d(u,v) denote the distance between u and v, for any u,v G V. A path 
v\ — ► V2 — ► ■ ■ ■ is called a self-avoiding path if Vi / Vj for all % ^ j. The distance 
between a vertex v e V and a subset Ac^is defined by 

d(v,A) = imn{d(v,u) : u G A}. 

The set of vertices with distance I to the vertex v is denoted by 

S{G,v,l) = {u : d(v,u) = I}. 
The set of vertices which are no more than I away from v is denoted by 

V(G,v,l) = {u : d(v,u) < I}. 

Let 5 V denote the degree of v in G and A(G) = max{5 v : v G V}. Let all the vertices 
in graph G = (V, E) be numbered, where V and E are vertex set and edge set of G 
respectively. We define the partial order on E, where > (k, I) if and only if 
and (k, I) share a common vertex and i + j > k + 1. In two-state spin systems on G, 
each vertex % G V is associated with a random variable Xi onQ = {±1} (± in brief). 

Definition 1. The Gibbs measure of two-state spin systems on G is defined by 
the joint distribution of X = {Xi, X2, • • • , X n } 

P G {X = cr) = — — exp( ^ PiA u ii a i) + h i( a i))- 

where hi is a map U — > R and /3y is a map — > i?. ^(G) is called the partition 
function of the system. 

Note that the Gibbs measure would satisfy YlaeQ" Pg(X = a) = 1. We use 
notation (3ij(a, b) = (3ji(b, a). For any A C V, a\ denotes the set {cij, i G A}. With a 
little abuse of notation, <ta also denotes the condition or configuration ai with fixed 
i for any i £ A. Let Z(G, denote the partition function under the condition 
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e.g. Z(G, X\ = +) represents the partition function under the condition the vertex 
1 is fixed +. 



Tsaw(l) 
1 




Figure 1: The graph with one vertex assigned + (Right) and its corresponding self-avoiding 
tree T saw{1) (Left) 

A self-avoiding walk (SAW) is a sequence of moves (on a graph) which does not 
visit the same point more than once. The following gives an important tool in prov- 
ing our results. It is introduced in [To]. 

Definition 2. (Self- Avoiding Tree) The self-avoiding tree T saw r v \(G) (for simplicity 
denoted by T saw ( v \) corresponding to the vertex v of G is the tree with root v and 
generated through the self-avoiding walks originating at v. A vertex closing a cycle 
is included as a leaf of the tree and is assigned to be +, if the edge ending the cycle 
is larger than the edge starting the cycle, and — otherwise. 

Remark: Given any configuration a\ of G, A C V, the self-avoiding tree is con- 
structed in the same way as the above procedure except that the vertex, which is 
a copy of the vertex i in A, is fixed to the same spin cij as i and the subtree below 
it is not constructed due to the Markov property, see Figure 1 for example, where 
vertex 5 is fixed + in G. 

Definition 3. (Strong Correlation Decay) The Gibbs distribution of two-state spin 
systems on G exhibits strong correlation decay if and only if for any vertex v £ V, 
subset A C V, any two configurations o"a and t/a on A, denote t = d(v,Q), where 
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= {v G A : a v / 77,,}, there exits positive numbers a, b independent of n such that 

| \ogP G {X v = +\a A ) - logP G (X v = +\n A )\ < f(t), 
where decay function f(t) = aexp(-bt). 

Definition 4. (FPTAS) An approximation algorithm is called a fully polynomial 
time approximation scheme (FPTAS) if and only if for any e > 0, it takes a polyno- 
mial time of input and e _1 to output a value M satisfying 

e M 
e < — — < e e , 
~ M ~ 

where M is the real value. 

3. Strong Correlation Decay 

In two-state spin systems, when /%(<Jj, Oj) = JijCTiUj, hi = BiOi for all the edge 
€ E and vertex i £ V, and Jij is uniformly negative/positive for all (i, j) G E, 
the system is called antiferromagnetic/ferromagnetic Ising model. Let 



Jij 



+) + -) - /%(-, +) - Pij(+, -) 



and Bi = h ^ + ) ^( ) f or edges and vertices. We call Jij and Bi 'inverse temper- 
ature' and 'external field' of two-state spin systems. Let J = max(jj) g E |Jjj|. The 
main theorem in this section is summarized as follows 



Theorem 1. Let G = (V,E) be a graph with vertex set V = {1,2,- •• ,n} and 
edge set E. There exists a numbers d > such that A(G) < d. Suppose 

(d - l)tanh J < 1, 

that is equivalent to J < Jd = ^logl^r^); then the Gibbs distribution of the two- 
state spin systems on G exhibits strong correlation decay for arbitrary external field. 
Specifically, decay function is 



f{t) = AJd{{d- l)tanh J) 



t-i 



In order to prove Theorem 1, four technical lemmas are given first. The inequal- 
ity in Lemma 1 is inspired by a similar result in |10| . 
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Lemma 1. Let a, b, c, d, x, y be positive numbers, g(x) = and t = | 
then 

,q(x) q(y) . . ,x y..+ 
max < max *. 



Proof. We separate the proof into two cases. 
Case 1. ad > be. Consider a function 

. . ax + b a ad — be 
9{x) 



cx + d c c(cx + d) 

It is clearly an increasing function. Without loss of the generality, suppose x > y 
and let x = zy, where z > 1, then 



(S M )= r ^Ml da= r ( _js!_ )da 

g(y) J 1 da J 1 aay + b cay + d 



(ad - bc)y _ rfa 



f 

Ji (aay + b)(cay + d) 

(ad — bc)y 



i {yfacay — ybd) 2 + ( \fbc + \fad)' 1 ay 



-da 



Hence 



where t = 



(ad — bc)y . y ad — ybc 
< / — -= = da = —= -=\ogz. 

'i (ybc + V ad) 2 'ay yad + ybc 



g(y) g(x) g(y) y y x 



lad— ybc 



Vad+Vbc ' 

Case 2. ad < be. Now g(x) is a decreasing function. Let h(x) = l/g(x), then h(x) 
is an increasing function. Suppose x > y, it is easy to be obtained that 

h(x) ,x. Vfce-vag 

V y < ( — )V^d+Vte. 

h(y) y 

Hence 

max(^, 'M) = SM = m < ( £). = W £, »))., 

%) i/ y x 

where t = ^T^P - □ 

V ad+ybc 

Lemma 2. Lei T = T(V,£') 6e a rooted tree with vertex set V = {0, 1,2, ■■■ ,n} 
anc? edge sei E. The root is vertex 0. Suppose some vertices are fixed(assigned to 
certain spins) on T. Removing an edge (k,l), where d(k,0) < d(l,0), let and 
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Ti be two resulting subtrees of T including vertex k and I respectively. The fixed 
vertices remain fixed on T k and T\. Then the probability P(X = + on T) equals the 
probability P(Xq = + on the subtree T k ) except changing the 'external field' h k to 
certain value h k on T k . 

Proof. Let J7t ( denote the configuration space on T\ . E\ and V\ denote the edge set 
and vertex set on T\ . The following equality implies the result of the lemma. 

. f3ki(°-k,n)+ E Pi]{n,Tj)+ E hi(n) 
h(a k ) = h k (a k ) + log( e (lj)eE; ieVl )• □ 

ren Tl 

With Lemma 1 and Lemma 2, strong correlation decay property on trees will be 
proved. 

Lemma 3. Let T = T(V, E) be a rooted tree with vertex set V = {0, 1, 2, ■ ■ ■ , n} 
and edge set E. The root is vertex 0. Consider the two-state spin systems on it. Let 
A C V , (a and tja be any two configurations on A. Let = {i : Q / rji, i £ A}, 
t = d(O,0) and s = \S(T,0,t)\ = \{i : d(0,i) =t,i€T}\. Then 

m W Pr(X ° = +ICA) P t(X = +\Va) , < 4Js(tanh J)* -1 

mSX[ P T (X = +\VA) ' Pt(X = +|Ca) ' ~ 



Proof. For any i £ V, let Tj denote the subtree with i as its root and Z(i) be 
the two-state spin systems induced on Tj by T. Note that To is equal to T. To 
prove the theorem, it's convenient to deal with the ratio p^(Xo=-|ca) ratner than 

P T (X = +|Ca) itself. Denote = ^|*i=-|cA ) ' where ^ is the condition b y 
imposing the configuration ("a on T; L . When x\,x 2 € (0,1), f 1 > 1 if and only if 



> ^2-. Then 



1 — XI — l — X'2 

(XI X 2 , f X 1 /(l-X 1 ) X 2 /(1~X 2 ) 

max{ — , — } < max{ — — '-, — — -}. 

x 2 xi x 2 /{l-x 2 ) Xl/(1-Xi) 

Replace x\ and x 2 by Pt(Xq = +|Ca) and Pt(Xq = -I- 1 77 a ) • Then lemma 2 follows 
by 

max( P T (^o = +|*?a) ' Pr(X = +|Ca) } " maX( «2 A ' R^ } ' 
Hence what is needed to be proved becomes 

maX ^' Si) ^ exp(4J S (tanh J)*" 1 ). (1) 
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The inequality (1) is proved by induction on t. Before doing it, some trivial cases 
need to be clarified. We are interested in the case t > 1 and is unfixed. Let 
Tm denote the unique self-avoiding path from k to I on T. If i is a leaf on T and 
d(0,i) < t, where t = (2(0,6), define U t = {j G V : j G r 0i ,3/c G S(T,0,t), s.t.j G 
Tofc}- Ui $ because of G Ui. Let jj G C/j such that d(i,ji) = d(i, Ui). By lemma 
2, we can remove the subtree bellow ji and change external field from hj i to hj. 
at jj without changing the probability P(Xq = +). It is noted that this procedure 
removes at least one leaf with the hight < t, and does not remove any vertex with 
the hight > t. We can suppose that T is a tree rooted at and the height of every 
leaf on the tree is no less than t. Let Oi, O2, ■ ■ ■ , q be the neighbors connecting with 
0. The recursive formula can be presented. Let fi^ denote the configuration space 
in Tj under the condition (\, i = 1,2, • • • ,q and Qo denote the configuration space 
of To under the condition (a U {00} . We have 

„Ca = Z ( T 0, X = +>Ca) 
Z(T ,X = -,Ca) 

E (Ax); (+,co E /3fci(°"fc,°l)+ E M°"fc)) 

1T6Q0 

E(Ao i (-,o-o i )+ E /3fe(( cr fc>cT!)+ E h k (o k )) 

e ho(-) ^ e i=1 (fc.Oe^ fceT; 

A)0 i (+,°'0 i )+ E Pkl{o k ,ai)+ E h k (cr k ) 
= e 2Bo TT ^ 

11 A>0 i (-,<T0 j )+ E Pkl(o- k ,(Tl)+ E h k(°k) 

= e 2 - 80 TT a » Z ( T o»'^ = +>CaJ +^-Z , (T 0i ,X i = -,CaJ 
Al Q Z(T 0i , X, = +, CaJ + diZ(T 0i , = -, CaJ 



= e 2B 



i=l c *-^of + d 



(2) 



n 



where B = fc ° (+) 2 /t " ( ~ ) , a* = e*o l (+,+) ) ft. = e A» i (+,-) ) c . = e /aoo i (-,+) > rf. = 
gfto^-,-) _ Now checking the base case t = 1 where Rq^,Rq^ G [0, +00], by the 

monotomcity of — and — -h* — n 

ciR^+di ciRZf+di' 

m^,^) < f[max(^,-^) < e 4 « J . 
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Hence, (1) holds when t = 1. By induction, assume that (1) holds for t — 1, we will 
show that it holds for t. Let Sj = \S(T ., Oj, t — 1)|, i = 1, 2, • • ■ , q, repeating above 
recursive procedure, then 



max 



^° ) < TT max( ^_^, 



< 



II max (#'— ' 



i=l 



0, 



a i d i+V b i c i 



""-Oj ^ NtanhJ 



< I I max( . 
- 11 RH fA 

i=l ^ -Koi 



where the second inequality comes from Lemma 1. According to the hypothesis of 
induction max( — — < exp(4Jsj(tanh J)' -2 ), it's sufficient to show 



max(-— — ^-) < exp(4Jsj(tanh J) 

-^i 



t-i\ 



i=i 



exp(4Js(tanh J) t_i ) 



where the last equation follows by Y*L=i s « = s - This completes the proof. □ 

To generalize the strong correlation decay property on trees to the general graphs, 
we need to utilize the remarkable property of the self-avoiding tree, which is implic- 
itly stated in [15] and explicitly stated in [8]. 

Lemma 4 ([8]). For two-state spin systems on G = (V,E), for any configuration 
a a, A C V and any vertex v S V, then 



P G (X V = +\a A ) = P Tsaw(v) (X v = +\a A ). 



With Lemma 3 and 4, it is enough to prove Theorem 1. 



Proof of Theorem 1. Since the maximum degree of T saw ^ is also bounded by d, 
obviously, s = \S(T saw ^,i,t)\ < d(d— 1) <_1 . According to Lemma 3 and 4, Theorem 
1 is proved. □ 

Remark: From the proof of Theorem 1, by a similar argument, we can get 
| \ogP G {X v = -K) - logP G (X v = -\va)\ < f(t), 
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where f(t) = 4Jd((d - 1) tanh J)* -1 . 

As one of the corollaries of strong correlation decay property, we prove there is 
unique Gibbs measure on an infinite bounded degree graph (an infinite graph with 
maximum degree over all the degree of its vertices < d). This generalizes original 
Dobrushion's condition 

d tanh J < 1 to (d— 1) tanh J < 1 
for uniqueness of Gibbs measure of Ising models [1]. 

Theorem 2. Let G be an infinite graph and A(G) = sup{<5j}. Assume there 
exists a constant d such that A(G) < d. There is a two-state spin systems on each 
sub finite graph G of G which is defined by Definition 1. If (d — 1) tanh J < 1, then 
the Gibbs measure on G corresponding to the two-state spin systems on sub finite 
graphs is unique. 

Proof. For any given finite sub graph G = (V,E) of G, let dG = {i : G 
G,i ^ G,j £ G} and G = Go. Suppose there is a sequence of finite sub graphs 
G n -\ C G n of G, n = 1,2,- •• ,oo such that d n = d{G,dG n ) goes to infinity as 
n — > oo. Let G' n = G n U dG n and denote r/ n any two configurations on dG n , for 
n = 1, 2, • • • , oo. Let a\ be any configuration on A, A C V. By Proposition 2.2 in 
[13] . the Gibbs measure is unique on G if 

lim sup max \P G >(X A = a A \Cn) - Pg>(Xa = a\\ri n )\ = 

holds. Let A = {1,2, ••• ,m}, where m = |A|. Set a n (l) = Pc n {Xi = cri\( n ) and 
(3 n (l) = Pg>„(Xi = (Ji\7] n ). Let a n (i) = Pa' n { X i = °i\Cn,°iA < 3 < * - 1) and 
j3 n (i) = Pc' n (Xi = ai\r] n ,aj,l < j < i — 1), i = 2,3, ••• ,n. The telescoping trick 
gives 

m 

Pg' u {Xa = (7 A \Cn) = Y[a n (i) 
1=1 

m 

and Pqi (X\ = a\\r] n ) = Y\ Pn(i)- By Theorem 1 and above remark, we know, for 

i=i 

each i £ A, 

|log(||)l</W, 
where f(t) is the decay function f(t) = AJd((d — l)tanh J)* -1 . Then 

^og(H^r)<mf(d n ), 
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where m = |A|. Hence 



sup max log(— ^— — -r—r) < \V\f(d n ). 

Cn AC V,a A Pf^ ( X A = a A I % ) 



Therefore, if (d — 1) tanh J < 1, then 



lim sup max log(— — — r ; — r) = U. 

n ^°° Cnfln ACV >A P G {, (^A = <TA\Vn) 



This completes the proof. □ 



4. Approximating the Partition Function 

In the proof of Lemma 3, the calculation of the marginal probability of the 
root yields a local recursive procedure. If the tree is truncated at height t, and 
using the recursive formula (2) to compute the marginal probability at the root, it 
is easy to see that the complexity of this procedure is linear with the number of 
vertices of the truncated tree. Let $i denote the whole state space, which means 
P G {X 1 = = P G (X 1 = +), and * j = {X i = +,l<i<j-l},2<j<n+ 1. 

Let pj an estimator of conditional marginal probability pj = Pc{Xj = +|3>j), 
j = 1,2, ■■■ , n. The algorithm to compute the partition function is proposed as 
follows. 



Algorithm for Partition Function Z(G) 

Input: G, a graph with vertices {1, ■ ■ ■ , n}, the two-state spin systems on G, e > 0, 
precision; 

Output: Z(G), the estimator of partition function Z(G). 
begin 

For j from 1 to n do 

ctpn 1 Spt / • - log^nJde- 1 ) -, 

step i. Bet ij - i og (( d _i) tan/l j)-i t- i, 

step 2. Take the vertex j as root and generate the truncated subtree T' saw ^ 
with height th- 
under the condition 3>j, 
step 3. Set initial values be 0's for all the vertices of T' saw ^ at height tj , 
step 4. Computing p) through T' saw ^ by recursive formula (2). 
End For 

Compute Z{G) = Z(G,$ n+1 ) f[ p' 1 . 

i=i 

end 
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Theorem 3. Let G = (V,E) be a graph with vertex set V = {1,2,- •• , n} and 
edge set E. There exists a positive number d > such that A(G) < d. If J < J<}, 
then the above algorithm provides an FPTAS for partition function of the two-state 
spin systems on G. 

Proof. According to the results of Theorem 1, there is a function f(tj) < f t , 
such that 

_ ± Pj ± 

e n < < en , 

Pj 

under the condition that 

ti = ; — „, 7~\ r4r-r + 1 = Oflogn + log(e -1 )). 

3 log((d - l)tanhJ)- 1 v B &v 

Since = Z ,U £\ , Z(G) can be expressed as the product Z(G) = Z(G, ® n +i) Y\ Pj 1 ■ 
1 ' 3> i=i 

Hence, 

<r <- TT El 1 - <- c (-)« <- c e 

The complexity of the algorithm for each j in the loop is 



0(\V(T sawU) ,j,t J )\)=0((d-l) t >). 
Thus, the total complexity of the algorithm is 

£ 0((d - ^Odogn+Me-))) = n0{{d _ ^(tagn+log^ 1 ))) = 0(n °(l) + ^"1)0(1)), 

which completes the proof. □ 

5. Conclusions and Discussions 

We show that the Gibbs distribution of two-state spin systems on a bounded 
degree graph G = (V, E) with maximum degree d exhibits strong correlation decay 
when J < Jd- By the strong correlation decay property and the self-avoiding tree 
technique, we prove the uniqueness of Gibbs measure on an infinite bounded degree 
graph, which generalizes original Dobrushion's condition dtanh(J) < 1 to (d — 
1) tanh(J) < 1 for uniqueness of Gibbs measure of (anti) ferromagnetic Ising models. 
Since Jd is the critical point for uniqueness of Gibbs measure on an infinite d regular 
tree of Ising model. This implies that the condition for inverse temperature is tight 
when restricting it on Ising model. 
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It is not difficult to apply our results to the sparse on average graphs [TT] and 
Erdos-Renyi random graph G(n, d/n), where each edge is chosen independently with 
probability d/n We also present an FPTAS for partition functions of two-state 
spin systems on the bounded degree graphs. An interesting investigation could be 
whether the condition is sharp for the general two-state spin systems. 
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